Papers with explicit cross-lingual training data
Exploring the Relationship between Alignment and Cross-lingual Transfer in Multilingual Transformers (2023.findings-acl)
Copied to clipboard
| Challenge: | despite lack of explicit cross-lingual training data, multilingual models can achieve cross-linguistic transfer. |
| Approach: | They find alignment is significantly correlated with cross-lingual transfer . they advocate for further research on realignment methods for smaller models . |
| Outcome: | The proposed method outperforms XLM-R Large in POS-tagging between English and Arabic by +15.8 accuracy. |